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ABSTRACT 

A class of multidimensional latent trait models is : 
described. The properties of the model parameters, and initial 
results on the .accuracy of a maximum likelihood procedure for - • 
estimating the model parameters are discussed." The model presented is 
a special case of the general model described by Rasch (£961), with' ' 
close similarities to the models suggested by Bock and Aitkin (1981) 
and Samejima (1974). The concepts of item difficulty and 
discrimination were discussed in reference to this model as 
generalizations of the- same concepts used in the unidimensional 
latent trait models. -For this case, difficulty was shown to be 
defined by a function rather than a single value,, and discrimination 
was shown to be related to the slope of 'the item characteristic 
surface at rts intersection with the .5-plane. Both the difficulty 
function and discrimination parameters are most easily interpreted 
when determined conditional on a particular dimension. The maximum 
likelihood estimation procedure that *as developed for the model was 
given ari initial trial on a set of simulation data that was generated 
to contain two distinct dimensions. The item parameters estimated 
from the simulated test data were shown to be very highly related to 
the true parameters . (Author/PN) 
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• • set of test itfm ^, 0DP ^ ° f the - inte "^ion betweep a person and a 

• model! L J? 33 beeQ 3 continu "i n « search for multidimensional 

' -t a i„ an k1 ; 8 be *avxor Although test results are sometimes thought 
Lt! /?, f S ° m ! ld£al continuu *> this hypothesized state of 

vocabularv n a e nd r nS 7 "k^" EVCa tonce PtH-lly a^rple tests such as 
vocabulary and number series are found to have seve/al components if thev 
are studied closely enough (Holzman, Glaser and Pellegrini J5o) Many 

Lnt tts'ts^re^-^r'H' t0 1 MBre * sin * le trait Sie, achieve- 

ment tests are typically designed to measure" a number of content areas A 
single achievement dimension is not usually defined. 

nature^LT^V^ 11 £ ^ P3St t0 deaL with multidimensional 
nature of test data has be^en to det-rtaine the number and composition of thp 
components ma test and to use that information to form tesS measurin* a * 
for 8 he Jurp'se 011 ^ • tbe Procedure, that havele^de^l pe'd 

do nol \S^U iS r S?H t ; 8t 'T/^ 0 I'** a single dimension 

multiDir^rl^ J '-^ t yi6lded by the tyPi" 1 . dichotomously scored, 

wiJJ ?ne seJectio'n^f emS '- 1 FaCt0r aQalySiS " plagued ^ problems^ dealing - 
wxtn the selection -of a similarity coefficient, the effects of euessin* on 

continuous data on dichotomous scores (Kim and Mueller, 1978). The use of 
HTZTl C mult J dimensiona l scaling as an alternative to factor analysis ' 
.has not been well researched, and the results that have been repAted are 
inconclusive (Reckase, 1981). reported are , 

H*t- a ^ alte ™ate approach to' the problem of multidimensionality in test 
dicho^Lu, deV " P I m ° del th3t " deSi8Qed t0 ex P lain tb * responses to 
In a sen se Jhl^SS h^V^ 8 - * ^ ° f ^^Ketical'di.ensions . . 

from a factor ana fl- ^ by Christof fers son (1975) and Muthe'n (1978) 
computation El* " P61 ?P ectlve > but their approach "requires extensive 
computation The approach presented in this paper is to describe the 
. multidimensional interaction using a latent trait approach, which will have 
the advantages of using the sample-fr'ee properties of laWfc trait theo J 
ma^on 6 ^^!^ 7 ° f ^ ^ ,s the itef and^ttfoT- 



mn ^il° ^ ate !" lxt 5 le w ' ork has been done with multidimensional latent trait ' 
models despite the fact that several variations have been described in the 

J ' wultei y» lysuj. For the most part, the references to 

P t a ;" PJ es * nted at the meeting of the American Psychological Associ- 

ation, -Washington,. D.C., August 1982. This research was supported bv 
r contract number NR0014-81-K0817 from the Personnel anr^aining Research * 

Programs of the Office of Naval Research. 8 Kes . earc " 
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♦ « 

the models in* the, literature are only -descriptions of t\ie mathematical- 
'f&tms with little information about actual applications. Guidelines for 
the 'interpretation^ results obtained using these models afenonexistent , 

TJiis paper will 'discuss one class of .multidimensional latent trait 
models that is related to the models proposed -by Bock and Aitkin (1981) , 
Rasch (1961), and. Samejima \4974) . The fo*m of the model will be presented 
first and information concerning the interpretation of the model parameters 
will be given. Also, the applicability, of the model to test data will be 
demonstrated using Simulate^ item responses. 

J , t Characteristics of the Model - 

' . The particular multidimensional latent trait, model presented here was 
selected on the basis of a detailed analysis of the general Rasch model 
(1961). A full report of that analysis was giv<*n elsewhere (Reckase and 
McKinley, 1982) . The equation foi the model is\given by 

•* 

« n 

fg i, ■ Hgi. v - • • . — w 

1 + « 



whete x. is the score on Item i for Person p, 

on is a vector of item parameters for Item i* 
and 0 p is a vector of perspn 'parameters for Person p. 

The relationship between the probability of a correct* response and the 
0-vector for. this model defines an item response surface. An example of 
the item response^rface for the two dimensional case of this model is 
given ip FigUBjfT wit&s?* = 1.5, a 2 = .5 and a 3 = .650! Note that this 
surface. is m^notonicAlyN^ncreasing in both Q x and 6 a < 
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Insert Figure 1 about here 
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. In order to interpret the parameters of this model, the traditional 
concept of item difficulty and discrimination must be extended to the 
multidimensional case..- In unidimensional latent trait models, the diffi- ' 
culty of an item is defined as the point on the 6-scal'e below the point of 
inflection «of the item characteristic curve (See Figure 2). This vdlue can 
be 'determined by s e«4n g the second partial derivative* of the model with 
respect to 0 to zeflKd solving for 6. The same procedure can be followed 
for the multidimensWlal model, except that the second partial derivative 
is now taken with respect tc the 6-vector. For this -particular model, the 
solution of the second partial derivative yields -a function rather than a 
single value for the difficulty of the ^€em. The function is given by 



•3- 



n ' . f 

j=1 iJ PJ . i(n+l) u , „ (2) 



Where the o- (and 6-terns are the elements of the o-'.ahd 6-vectors ' For ,h. 



l-59pl' + "pa- • 650 = 0 - ' '' (3) 



Se'dashed'lfnH 13 ,^' 5 * V™ in *' ? ' • f 1>ne; T " e *■ show, by 

loca 2TSSJL ofce siL^Sis 1i« ? "T™ 1 »«» 1 <"» l ° Actors 

Parallel to tne o 1)k 0 2 plane at a probability of .5. 
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sionafL^e't^irthL^^i^^H'" 111 ' 7 "* be ^neralized from u'ni dime n- 
r=,n *u a trait theory to multidimeneional latent trait theofv so to 

can the concept of item discrimination. In. uaidimension'al the v r ' 
discrimination parameter for an item is a fuSon of Z slopHf £ item 
characteristic curve at the point of inflection (see FigUre 2)' For the 
two parameter logistic model, this function is given by 



a _ (slope at b ) x 4' V 
8 " 17.^ ' 



fraction M'?r iV ? e "" h reSfeCt t0 ' e f ° r V»lue} on the diffilulfy ' 

SK? o^the e^res & "TfoT^? 1 ^ ^c"" * V 1 ** 
for thp i>am rt «iv:« • id , inus, tne discrimination parameter 

with respect to Dimension 1 -i* „^ &* vc J±.^_J-ig.4fe i, tne slope 

. 1?S tL , * uini f nsi P n 1 -375, and with respect to Dimension 2 -it is 

^--^ 

the a-vector can be considered as discrimination parameters.' ' 
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Estimation of Para meters 

* * ; : 

The development of a model alone is not sufficient to show that a, 
multidimensional latent trait model is* a practical possibility. A procedure 
must be developed' to estimate the parameters of the model with sufficient 
accuracy to Judge whether they yield .useful information about thfe test 
items and the examinees. 

For the model presented in Equation 1, 'an empirical maximum likelihood 
^procedure has been developed for the estimation of t;he person, and item 
parameters. The item parameter estimation procedure begins with an initial 
estimate of the, item parameters based on a weighted sum of ability parameter 
estimate's. These values are 'used as the starting point for an iterative 
Newton-Rapteon prqcedure^ that modifies the item parameter estimates on each 
dimensioa before estimating those on the next dimension. The iterations 
continue until' successive estimates of the parameters do not differ' by * 
' more, than a specified value. A full description of the procedure is given 
in Reckase and McKialey (1982). 

* The ability parameter estimated are determined in a similar fashion. 
Initial parameter estimates are obtained from a weighted sum- of the item 
parameter estimates. The initial values are used as the* starting point in 
a Newton-Raphsoh procedure for finding the maximum of the likelihood function 
f<Jr the data. This procedure is also described in- Reckase and McKinlev %t 
'(1982). - * ' 

In order to determine the practicality of the estimation procedure 
that was developed, it was applied to a set of simulated test data that was 
generated to fit the model, The^ simulated test data contained resppnses on 
50 items for 1,0*00 exaimees*. The data were generated to model two distinct • 
ability dimensions. The item parameters used to generate data to fit the 
model are given in the second through fourth columns of Table 1, The fi$st 
of these thrde columns gives the ^/ +1 \ term from the model and the other 
two columns give the discrimination parameters • fc The ability parameters ' * 
.used, to generate the data were samp led^Trom- "the bivariate normal distribution 
>ith g = 0, {j = 0 and I, = I.. 



Insert Table 1 about here 



The results of the item parameter estimation procedure for thr two- 
-dimensional model are presented in the last, three columns of Table 1. « 
Thfese estimates have been scaled to have the same mean and standard devi- 
ation as the true parameters. The . correlations between the^parameter 
estimate© and the true values are given rin Table 2,** From the information 
presented," it can be seen that the parametfc^estimates are very highly 
related to the tsue values. While this does*n"iH^conclusively show thd 
vglue of this estimation procedure, t^e results. c 2re^ggest that the pro- 
cedure is very promising. 
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Summary 



UtanttriS?^?! ^ Paper " aS t0 descri - be a class of multidimensional 
latent trait models, discuss the properties of the model parameters and 
give some initial resuKs on the accuracy of a maximum likelihood procedure 
. for estimating the model parameters. The model presented- is a special case 

, 2r2Lf e ;:-S- BOd T 1 i de?Crlbed - by RaSCb Cl961) - Xt also has close simi- 
(1974). 6 °- ls \ su 88 ested by Bock and Aitkin (1981) and Samejima 

reference C to C ^l S d±fficu }9 ^ discrimination were discussed in 

unf Humane • ^ h ", mode l as generalizations, of the same concepts used in the 
unidimensional la£ent trait 'models. For this case, difficulty was shown to 

shown tot * i ^"V^?" than a value, and discriminates 

shown to be related to 'the slope of the item characteristic surface at its 
intersection with the .5-plane. Both the difficulty function and discrimi- 

f3 r3 T er !- are m ° ?t 6aSily ^erpreted when LLrmined-conditioLl 
on a particular dimension. " & \> . 

™H^ T !f- maXimUin like l ih . 00d estimation procedure .that was developed for the 
model was gxven an initial trial on a set of simulation data tk? was ' 
generated to contain two distinct dimensions.' The item parameters estimated 
from the simulated test data were' shown to .be .very highl? related to the J 

llTJnllT et T-< B ^K ed 0a th6Se r6SUltS > and 0n ^ he i^rpretive resets ' 
Iht 11' ^ m ° del SeemS V6rV V™****S as .a means of describing 

Utent space * * '"^ ^ * t6St iteyn in 3 ^Itidimensional * 
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Table 1 i 
True and Estimated Item Parameters 



Item 



True Parameters 





1 * 

X 


2 


/ 3 


.. '-.1 


~Q.65 ... . 


-1.50 


Q.50 


2 


-1.40 


0,50 


' 1:25 


3 


-0-. 20 


1. 35 


0.15 


4 


0.40 ' 


1,60 


0.55 


5 


0.00 


0,50 


1.15 


6 


-1.30 


0, 35 


1.05 


7 


0.05 


* 1,45 


0.35 


8. • 


0.19 


0, 25 


1 40 


9 


-0.17 


0, 85 


0 85 


10 


0-.14 


* J.,75 


0 45 


* 11 


0.37 


0,60 


0 80 


12 


0.87 


1. 65 


0 65* 


13 


r0.93 «- 


0,35 - 


• 1 35 


14 


1.85 


0,65 


1 65 


, 15. 


0.06 


0,65 


0 65 


16 


-0.41 . 


0,45 


1 45 


17 


-1.54 


0, 75 


1 25 


18 


0.34 ' 


1,55 




19 


-0.15 


0, 65 


• 1 3 5 

X . J J 


20 


1.48 


1,25 


0 45 


21 


-1.45 


1„65 


0 45 


22 


>0.75 


0,45 


1,35 


• 23 v 


-0.75 


0.35 


1 55 


24 


1.10 


-1.10 


0.30 


25 


-0.55 


1.20- 


0 1 5 

V . X J 


26 


0.50 


0,50 * 


1 00 

X . \J\J 


27. 


-0.15 • 


■ 1,45 


0 45 


28 


0.65 


0,70 


0.70 


29 


-1.00 


1,00 


0 30 / 

1 Ofl' 

X . \J\J 


30 


lrOtT 


'0.3'0 


31 


-0.25 


0,95 


*0 25 
v • **** 


32 


-0.70 . . 


0,15 


1 50 


33 


0.85 


* 1.15 


0 45 


34 


0.05 


0.10 f 


0 95 


35 , 


-0.95 


1,35 


0.50 


36 


-1.50 


0,20 


1 20 


37 


1.80 * 


1.58 


0 55 


38 . 


-2.00 


0,15 


1.15 


' 39 1 


-0.90 


1,40 


0 35 


40 


1.00 


1,00 


1 00 

X . \J\J 


41 


0.15 


1,25 


0' 70 


42 ' ' 


-1.50 


0.25 • 


0 95 


43 


-1.25 . 


0.35' 


1.45 . 


44 


1.25 


1.30 


0.25 


45 


-2.00. 


1.15 


0.15 


46 


1.75 


0.50 


0.50 


47 


0.65 


0.65 


1.30 


48 


-0.25 . 


1.00 


0.45 


49 


0.35 . 


0.35 


1.15 ^ 


50 


0.00- 


0.95 


0.15 



Maximum Likelihood 
Estimates 



-0.48 1;27 
-1.56 0.45 
-0.06 1.69 
„ 0.59' j..58i 
0.10 0.51 
-1.68 0.42' 
0,34 1.63 
0.25 0.20 
-0.07 0.89 
0.34 1.45 
0.29 0.61 
0.70 1.38 
-1.00 0.24 
'1.59 0.54 
0.00 j • 0.80 
-0-38 , 0.23 
-1-55 ' 0.71 
0.39 1.46 
0.04 0.65 

1-42 1.32 

-1-73 1.80 
, 0.67 . 0.40 

-0.63 0.21 

0.93 i.n 

-0/38 1.37 

0.28 .0.49 

-0.02 1.32 

0.56 0.68 

-0.95 1.14 

0.98 0.27 

-0.04 i.n 

-0.68 0.03 

0.98 1.29 

0.03 0.20 

x0.80 1.28 

-1.38 . '0.47 

'2.06. 1.51 

-2.06 0.30 
, "0.70 . i.is 

, 1-04 0.87 

0.28 1.17 

-1.60 0.4.9 

-1.13 0.26 

0.95 1.26 

-2.01 1,30 

3-65 o.68 

0.71 0.49 

-0.17 1,03 

0.24 0.48 

-0.07 i.n 



- 0.36 
1.29 
0.25 
0.63 
'1.04 
1.25 
035 

1.23 
0.67 
0.57 
0.88 
• 0.46 
1.65 
1,29. 
0.52 
1-60. 
1.14 
0.29 
1.28 
0.22 

0. 48" 

1. ^35 
1.72 
0.35 
0.24 
1.12 
0.42 
0.86 
0.38 
1.14 
0.24 

,1.51 
0.30 
. 1.09 
0.52 
li.03 • 
Q.44 
1.09 
0:40, 
0.79 
0.75 . 
1.14 > 
1.30 
0.26, 
0.13 
0.64 
1.27 
0.53 
1.04 
0.26 
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Table 2 



Intercosrelation Matrix for True and. 
Estimated Item Parameters 



4 ^ 

Parameter 


True 


* 

Parameters 




Estimates 




°T1 


°T2 


°T3 , 


A 

°ci 


°C2 


a C3 
















• °T1 


llOO 


0.21 


-.12 


0.99 


6.15 


.18 


a „ 
T2 


0.21 


1.-00 


^•75 , 


. 0.15 


0.96 


-.79 


°T3 


-.12 


-.75 


, 1.00 


-.18. 


-.79 


-.96 


a ci 


0.99 


0.15 


-.18 


1.00 


0.20 


-.22 


°C2 


0.15 


0.96 


-.79 


. 0.20 


1.00 


-.88 




-.18 


-,-ZSL 


-.96 


-.22 


-.88 


1.00 



/ 
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Figure 1 

Example of an Item Response Surface 
for the Two-Dimensional Case 
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